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Enabling a Service Provider to Provide Intranet Services 

Inventors 

Peter Newman and Pawan Goyal 

Cross Reference to Related Applications 

This application is related to U.S. Patent Serial No. 09/452,286, entitled "Providing 
Quality of Service Guarantees to Virtual Hosts", by Pawan Goyal et al., filed November 11, 
1999, and commonly assigned with the present application. The subject matter of related 
application U.S. Patent Serial No. 09/452,286 is incorporated by reference herein in its entirety. 

Background 

Field of Invention 

The present invention relates generally to providing private networking services, e.g. 
Intranet services, Iremotely, and more particularly, to allowing a service provider to locate and 
manage private network servers at the Service Provider's location, while connecting the servers 
to a customer's premises such that they appear to be local and private to the customer. 

Background of the Invention 
Networked computer resources are growing more popular as the benefits of sharing 
computing resources becomes evident. One of the fastest-growing segments of the Internet is the 
private network market. A private network is an interconnected group of computing resources 
accessible only by the network members. Security protocols are used to ensure that only 
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authorized users have access to the network's resources, even where the network operates on the 
public network infrastructure and protocols. A private network, often belonging to a corporation, 
may be used to store web pages and other shared information. This information is maintained in 
a private space, generally screened off from external sources such as the Internet by a firewall 
5 which blocks unauthorized access. Such private networks are often referred to as intranets, local 
area networks (LAN) or wide area networks (WAN). 

In a typical LAN implementation, a single location contains a group of individual user 
computers, as well as one or more dedicated host computers executing server programs to 
maintain the network's shared information. The private LAN is screened off from the Intemet 

O 

J] 10 by a firewall, though users may access the Intemet if needed. Network traffic intended for the 

t =31 

Ul 

nj network is allowed through the firewall only if authorized. The resources within the LAN all 
may communicate using private addresses. It is not necessary to use registered IP addresses for 
each resource because the system is screened off from the global Intemet. 

bi This model may be extended to multiple location sites. Computer networks that span 

yi 15 relatively large geographical distances are typically referred to as WANs. In a private WAN, 

Q individual sites must be connected in a secure manner. A secure connection between WAN sites 

may be accomplished using a virtual private network. A virtual private network utilizes ordinary 
Intemet protocols and may also use public communications mediums to connect; however, 
privacy is ensured through features such as^^^nelii^^ encapsulation) or the use of leased 
20 lines. A leased line is a permanent connection between two points that is always active. 
Resources on a WAN may commimicate using only private addresses because the network is 
screened off from the global Intemet. 
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Private networks contain common elements. Each generally contains a dedicated local 
server to maintain the shared private network data, and a conmiunications system for providing 
data communication services between machines on the private network. Communication takes 
place using a private address space. Because the address spaces for individual private networks 
5 need only be locally unique, the address spaces among several different private networks may 
overlap because the networks are isolated from each other. More specifically, in private 
intranets, two unrelated intranets at different companies may use the same local addresses for 
user computers. No conflict arises since the networks are not connected. 

Data communications services and servers are not easy to configure, manage, and 
I 10 maintain. Thus, there is an incentive for the service providers that offer access to 
communications facilities to provide such private network services and servers as well, thereby 
relieving corporations from the burden of providing these services directly. Some examples of 
service providers are: Internet Service Providers (ISP), Application Service Providers, Network 
Service Providers, and Competitive Local Exchange Carriers (CLEC). 

y1 15 It is not economically feasible for a service provider to remotely manage servers located 

Q 

on a customer's premises, and support many different customers in this fashion. Rather a service 
provider would prefer to offer private network services to multiple customers while keeping all 
of the server host computers within a location of the service provider for ease of management. 
Accordingly, service providers typically dedicate a physical host computer as each individual 
20 customer's server, and maintain each host computer in the centralized facility. However, this 
means the service provider will have to own and maintain potentially large nimibers of physical 
host computers, at least one for each customer's server or private network. However, many 
customers will neither require nor be amenable to paying for the use of an entire host computer. 
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Generally, only a fraction of the processing power, storage, and other resources of a host 
computer will be required to meet the needs of an individual customer. 

Alternatively, a service provider may utilize one physical host computer to provide 
commercial host services to multiple customers. Using Transmission Control Protocol (TCP) 
and other transport protocols, a server application executing on a single physical host can be 
programmed to process requests made to multiple network addresses. Such functionality is 



^ In ^^iitu^ customer is assigned a network address (or domain name), and is 

provided with resources on a single, physical host computer, effectively sharing the host with 
other customers. A client computer requests data from a specific customer's host by targeting 
communication requests to the appropriate network address (or domain name). The virtual host 
server can service requests to multiple network addresses or domain names. Thus, the 
functionality of numerous hosts is provided by a single physical host computer, servicing 
requests made to a plurality of network addresses and domain names by multiple customers. 

However, virtual hosting as it is commonly performed today ,does-nol^groyide many of 
— thej^eneficial Jea^^^ networks. Service providers will have to be able to provide 

certain features of private networks before customers wiUte^^^^to outsource services related 
to the operation and maintenance of their private network^^rst, customers will want to ensure 
that their private data is inaccessible to other customers sharing the same host computers. For 
instance, if a service provider provides email outsourcing for both Company A and Company B 
on the same computer. Company A will want to ensure that the directories in which its email is 
stored are not accessible to Company B, and vice versa. 



f 

known as virtual hosting, 
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y^^^dditionally, customers will want to ensure that their services are not compromised due 
to problems originating with another customer. If a service provider uses a single host computer 
to provide server^resources for both Company A and Company B, steps must be taken to ensure 
that overuse of the resources by Company A does not impact Company B's service. 
5 Additionally, faults, crashes, or similar problems caused by one customer must not compromise 
the service provided to another customer. Such performance degradation issues must be 
contained by the service provider to impact only the customer responsible for the problem, and 
not to impact any other customers. 

/ S Finally, companies A and B will want their servers to have IP addresses that belong to 
i|j 10 their own private address spaces. Using addresses from each company's own private address 

Ms 

HJ space offers more security because private IP addresses are not reachable over the public 

01 

l^f Internet. The use of private IP addresses guards against private servers becoming accessible 
from the public Internet by accidental misconfiguration of equipment. Also, public IP addresses 
are a limited resource; there is insufficient address space for private networks to consume 
Ijl 15 addresses firom the pubhc address space. Furthermore, if a company connects a number of 
servers or corporate locations together they will wish to establish a virtual private network. To 
run the routing protocols required for communications within a virtual private network requires a 
coherent addressing scheme. Such a virtual private network is easier to manage from a private 
address space. 

20 However, the use of private address schemes creates difficulties for the service provider. 

The service provider may now have several virtual servers assigned to the same IP address, 
because companies A and B may have overlapping address spaces, as is typical in private 
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networks. This address overlap can cause the communication network to fail. Typically, one of 
the virtual servers would become xmreachable due to this address overlap error. 

Thus in order to satisfy customers' needs, a service provider desiring to provide private 
network services must be able to guarantee four different kinds of isolation. Functional isolation 
separates the data and functionality of each customer. Fault isolation protects one customer from 
the fauhs created by another customer. Performance isolation allows each customer to receive a 
performance commitment independent of the behavior of other customers. Address isolation 
allows each customer to choose the virtual server IP address that it wants to be associated with, 
independent of other customers. 



10 
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Virtual hosting currently cannot provide these beneficial features of ordinary private 
r^'f -^"servers. This is due to the inability of a(\aitu^^ to allocate appropriate amounts of computer 
resources of the physical host computer to servicing client requests made to specific virtual 
hosts, and hence to specific customers. A private virtual server, by contrast, is able to provide 
Uj the functional, fault, and performance isolation that an ordinary virtual server cannot. A method 

Ml 15 for creating such a private virtual server is disclosed in the related application identified above, 
^ U.S. Patent Serial No. 09/452,286, entitled "Providing Quality of Service Guarantees to Virtual 

Hosts." 

However, a method and system is still needed to allow customers to use their own private 
address spaces to commimicate with a remotely-located private virtual server maintained by a 
20 service provider, where the private virtual server addresses may overlap. 
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Summary of the Invention 

The present invention allows providers of virtual servers to properly differentiate and 
^^^^ute transmissions using private addresses on a common host server. The term "private virtual 
server" as used herein is a virtual server that supports a private address space wherein the private 
5 address spaces of different privat e virt ual servers may overlap. 

Customers exchange privately-addressed transmissions with a service provider using 
tunnels to traverse the local or regional network connecting the customer with the service 
provider. The service provider receives the transmissions at a gateway into the service 
provider's data center. The service provider then routes the transmission to the private virtual 
10 server belonging to the customer that sent the transmission. The service provider also routes 
privately-addressed transmissions back to individual customers using tunnels. In this way, the 
service provider is able to implement a separate routing context on behalf of each individual 
customer. 

The present invention allows for flexibility in designing a private virtual server that suits 
15 an individual customer's needs. For example, an individual customer may have multiple 
physical sites all utilizing the same private virtual server. Optionally, an individual customer 
may be assigned more than one private virtual server, for instance, if different divisions of an 
organization each wish to maintain their own private servers while making all the data available 
to the organization at large. 




20 \ / / In one embodiment, the present invention comprises a multiplexing/demultiplexing 
mechanism capable of routing signals to and from one or more private virtual servers located on 
a physical host computer. Each private virtual server is associated with only one private 
network. The multiplexing/demultiplexing mechanism receives a privately addressed 
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transmission and routes it to the private virtual server with which it is associated. The privately 
addressed transmission may then be processed within the private virtual server in the same 
manner as if the server was actually a physical server resident within a LAN. The 
multiplexing/demultiplexing mechanism also receives an outgoing transmission from a private 
virtual server and routes it back to the private network associated with it. Incoming and outgoing 
transmissions are addressed using a tunneling scheme. Tunneling allows privately-addressed 
transmissions to be transported over a network that uses global addresses and allows customers 
to address their private virtual server using a non-unique private address. As a result, all 
transmissions to and from a customer are sent only to the customer's respective private virtual 
server. 

In another embodiment, the present invention includes more than^one^physical host 
computer. Each physical host computer contains one or more private virtual servers. Privately- 
addressed incoming transmissions are sent to the service provider's data center. The 
transmissions are placed on tunnels to traverse the local or regional network connecting the 
customer with the service provider. A tunnel switching mechanism is used to forward 
transmissions received at the service provider's data center to the proper physical host computer. 

In another embodiment, the present invention is a method for locating and managing 
private network services in a data center location remote from private network users. The 



method comprises receiving a transmission addressed using a private address of a recipient, and 
routing the transmission to a private virtual server. The correct private virtual server is 
determined from the address of either the sender or the recipient of the transmission. 

The foregoing merely summarizes aspects of the invention. The present invention is 
more completely described with respect to the following drawings and detailed description. 
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Brief Description of the Drawings 

Fig. 1 is an illustration of a private virtual server system in accordance with the present 
invention. 

5 Fig. 2 is an illustration of an embodiment of a private virtual server system v^ith 

individual tunnels between each customer and associated private virtual server. 

Fig. 3 is an illustration of an embodiment of a private virtual server system with a 
multiplexing/demultiplexing mechanism. 

Fig. 4 is a block diagram illustrating the timnel-to-private virtual server traffic flow of a 
10 multiplexing/demultiplexing mechanism. 

Fig. 5 is a block diagram illustrating the private virtual server-to-tunnel traffic flow of a 
multiplexing/demultiplexing mechanism. 

Fig. 6 is an illustration of an embodiment of a private virtual server system with 
multiplexing/demultiplexing mechanisms and a timnel switch. 

15 Fig. 7 is a block diagram illustrating the traffic flow of a tunnel switch. 

Fig. 8 is a diagram of a customer lookup table for a tunnel switch in an embodiment of 
the present invention. 

Fig. 9 is a diagram of a set of customer forwarding tables for a tunnel switch in an 
embodiment of the present invention. 

20 Fig. 1 OA is an illustration of an embodiment of a system for the separation of Internet and 

private virtual server traffic. 

0 
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Fig. 1 OB is an illustration of another embodiment of a system for the separation of 
Internet and private virtual server traffic. 

Fig. 11 is an illustration of an embodiment of a private virtual server system using 
Asynchronous Transfer Mode (ATM) layer two timneling. 

Fig. 12 is a block diagram illustrating the traffic flow of an ATM cell from a tunnel to a 
private virtual server. 
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Detailed Description of the Preferred Embodiments 

Reference will now be made in detail to several embodiments of the present invention, 
examples of which are illustrated in the accompanying drawings. Wherever practicable, the 
same reference numbers will be used throughout the drawings to refer to the same or like parts. 
The figures depict preferred embodiments of the present invention for purposes of illustration 
only. One skilled in the art will readily recognize fi"om the following discussion that alternative 
embodiments of the structures and methods illustrated herein may be employed without 
departing from the principles of the invention described herein. 



Q ^\ Fig- 1 is an /illustration of an embodiment of a private virtual server system, which 
10 replaces multiple private Intranet servers. A private virtual server system 100 includes a service 



us 

ni 

y1 



ri 



provider gateway 152 that connects to a service provider data center 150. System 100 is 
connected to multiple customer sites 110 via an access network 120. A set of customers, e.g. 
112 and 114, ard located in potentially any global location, although fi-equently the set of 
customers are loqated within the regional access network of the service provider. As will be 

La H 

O 15 evident to one of skill in the art, any number of customers may be supported by the private 

t s 
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virtual server system 100. Only the resources of the physical servers owned by the service 
provider limit the number of customers supported. Furthermore, a service provider may add 
additional physic al servers as required to support additional customers. 

As used herein, the terms "customer", "user", and "private network user" refer to 
20 individuals or groups of individuals accessing the same private virtual server. Typically, a 
private virtual server "user" is a group of individuals with a shared association. For example, 
"user" may collectively refer to the employees of a company, or to certain employees within a 
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division of a company. One company (a "customer") may have several different users, each 
corresponding to a different group within the company. Additionally, a "user" may also refer to 
a single individual. 

In the present invention, customers send and receive data using a network. In one 
5 embodiment, the protocol used within each customer's network will be IP (Internet Protocol). 
The IP addressing format will also be assumed herein for purposes of illustration. However, it 
will be evident to one of skill in the art that a different network protocol could be used instead of 
IP within a customer's private network, for example, Open Systems Interconnection (OSI), 
Internetwork Packet Exchange (IPX), System Network Architecture (SNA), and Asynchronous 
J^j 10 Transfer Mode (ATM). 

nj Data from customers 112 and 114 may optionally be aggregated 130 before being sent 

out over a local or regional network 140. Aggregation 130 is not required, but generally is done 
to concentrate data traffic for more efficient transmission over a network. For example, a 



customer site may aggregate the multiple data streams coming from various different users 



Aggregation 130 may also take place between customers and non-customers. This may 
occur when data transmission sites are located physically close together, to consolidate traffic 
flow onto the local or regional network 140. In another example, aggregation is also common in 
digital subscriber line (DSL) systems. A digital subscriber line access multiplexer (DSLAM) 
20 concentrates data traffic from multiple DSL loops onto the backbone network before connection 
to the rest of the local or regional network 140. Data directed to different destinations will be 
separated and individually routed within the local or regional network 140. 

12 
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(clients) within the site before transmitting data onto a public network. 



The local or regional network 140 connects a customer with a private virtual server 
system 100. The local or regional network 140 may be comprised of different types of 
interconnected networks. System 100 is capable of functioning with a wide variety of different 
local or regional networks 140, as will be evident to one of skill in the art. 

5 >ol Traffic from each individual customer 112 and 114 is aggregated 130 and transported 
across the local or regional network 140 until it reaches a service provider gateway 152. The 
service provider gateway 152 provides the connection into the service provider data center 150. 
The service provider gateway 152 directs traffic from each customer to the private virtual servers 
they own, and prevents traffic from reaching private virtual servers a customer does not own. 

10 The service provider gateway 152 connects to a physical server machine 160. The 

physical server machine 160 may be any kind of computer adapted to support private virtual 
servers. It is to be understood that a service provider data center 150 will typically contain more 
than one physical server machine 160. 

Located on the physical server machine 160 is a group of private virtual servers 162. In 
15 one embodiment, each private virtual server 162 is capable of implementing quality of service 
guarantees to individual customers. A service provider may implement different quality of 
service guarantees by allocating different percentages of the physical server machine 160 to 
servicing each of the private virtual servers 162. Thus the private virtual servers 162 may each 
consume a different percentage of the resources of physical server machine 160. This resource 
20 allocation may be dynamically changed by the service provider as required. 

In one embodiment, the IP network address of each private virtual server 162 corresponds 
to a private address from the private address space of the respective customer assigned to the 
private virtual server. A private address is any locally-assigned address, which does not have to 
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be unique within the global Internet. Conversely, a global address is a registered IP address that 
is unique within the public network system of communications. Generally, connecting a private 
network to a public network requires network address translation, which maps global addresses 
onto private addresses at the public/private network boundary. Private addresses are not routable 
5 in the public network, therefore transmissions cannot be sent to the private virtual servers 162 
across the public network 120 using only their private addresses. 

The network addresses for the private virtual servers are chosen to correspond to each 
customer's private address space. The private address spaces of customers 112 and 114 may 
overlap. Therefore, the network addresses for these customers' assigned virtual private servers 
10 may not be unique. It is possible for private virtual servers 162 to all be assigned the same 
network address. 

Thus the use of private addresses for the private virtual servers creates two different 
problems: such private addresses cannot be used to transmit data directly across a public 
network, and there may be address overlap among the private virtual servers. 

15 A solution to the problem of transporting privately-addressed transmissions is shown in 

Fig. 2. Fig. 2 is an illustration of an embodiment of a private virtual server system 200 that uses 
individual tunnels to connect between each customer and a service provider. The tunnels 
provide a means to transmit privately-addressed data across a public network. 

Fig. 2 shows a private virtual server system 200. The private virtual server system 200 
20 includes a service provider gateway 252 that connects to a service provider data center 250. A 
physical server machine 260 contains three private virtual servers 262. These private virtual 
servers may have overlapping private IP addresses. Private virtual server 262A is assigned to a 
customer 220, while private virtual server 262B is assigned to a customer 210. Customers 210 

14 
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and 220 are connected to the private virtual server system 200 via a local or regional network 
240. 

Customers 210 and 220 use tunnels to allow privately-addressed data transmissions to 
traverse the local or regional network 240. Customer 210 has a single tunnel 212 from customer 

5 210's site to the service provider gateway 252. Similarly, customer 220 has a single tunnel 222 
from customer 220's site to the service provider gateway 252. A tunnel is created by 
encapsulating a data transmission within a second type of addressing protocol. Transmissions, 
which use addresses that are unique only within a narrow scope, may thus be transported across a 
second network within a wider address scope. In this way, private IP addresses that are only 

10 unique within a private IP network are encapsulated for transport across the global public 
Internet. The origination of the timnel, on the customer's side, must occur before traffic from 
multiple customers is aggregated. The numbers of customers and private virtual servers shown 
in Fig. 2 is merely representative. It is to be understood that a service provider may have more 
or fewer customers. Furthermore, a physical host machine may contain more or fewer private 

15 virtual servers. 

System 200 demonstrates how a customer can be communicatively coupled to a private 
virtual server system using privately-addressed transmissions. However, once privately- 
addressed transmissions are routed across a public network, the problem of potential address 
overlap among the destination private virtual servers still remains. Fig. 3 demonstrates a method 
20 for routing transmissions to private virtual servers, where the private virtual servers may have 
overlapping address spaces. 

Figure 3 is an illustration of an embodiment of a private virtual server system 300 
including a multiplexing/demultiplexing mechanism 350. Private virtual server system 300 



2 1 81 6/04467/DOCS/967269.8 



15 




provides a separate routing context on behalf of each user to route privately-addressed 
transmissions between the users and the private virtual servers. System 300 is connected to three 
customer sites 310, 320 and 330. Each customer uses a tunnel to traverse the local or regional 
network 340 and arrive at a physical server machine 360 within the private virtual server system 
5 300. Customer site 310 uses a timnel 312, customer site 320 uses a tunnel 322, and customer site 
330 uses a tunnel 332. Each tunnel is a different data encapsulation. Multiple tunnels may be 
carried on the same physical medium connecting to the multiplexing/demultiplexing mechanism 
350. 

In another embodiment, the tunnels 312, 322, and 332 could be replaced with dedicated 
10 leased lines. A leased line is a permanent connection between two points set up by a 
telecommunications common carrier. A leased line is not part of the global public network, and 
therefore may carry privately-addressed traffic. 

The physical server machine 360 contains three private virtual servers 362, as well as a 
multiplexing/demultiplexing mechanism 350. Incoming tunnels 312, 322, and 332 
25 communicatively couple to the multiplexing/demultiplexing mechanism 350. The private virtual 
servers 362 may have overlapping IP addresses. A set of internal pointers 314 is used to direct 
traffic from the multiplexing/demultiplexing mechanism 350 to the correct private virtual server 
362, thereby communicatively coupling the multiplexing/demultiplexing mechanism 350 to the 
private virtual servers 362. 

20 The multiplexing/demultiplexing mechanism 350 performs the functions of separating 

incoming communication streams back into their original constituent streams, and merging 
multiple separate communication streams onto a single physical communications medium. In 
one embodiment, the multiplexing/demultiplexing mechanism 350 is implemented in the 
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network interface card of the physical server machine 360. The muhiplexing/demultiplexing 
mechanism 350 may be implemented in an application specific integrated circuit (ASIC) on the 
network interface card, or on the software driver. 

Incoming tunneled transmissions are sent on a physical medium as packet flows. When 
5 the multiplexing/demultiplexing mechanism 350 demultiplexes an incoming set of packet flows, 
incoming packets are stored in a buffer and one of the fields in the packet header is used to select 
the incoming packet queue to which the buffer should be linked. An incoming packet queue is a 
list of pointers wherein each pointer points to a packet buffer. Thus packets arriving with 
different tunnel identifiers are linked to different incoming packet queues. There is one 



J] 10 incoming packet queue per tunnel. 

Outgoing transmissions sent by the various private virtual servers are also packet flows. 
m Each private virtual server has its own outgoing packet queue. These packet queues are again 
. implemented as lists of pointers to packet buffers. The scheduler in the network interface card 

J J selects which of the non-empty outgoing packet queues it should serve next. The scheduler takes 



Ul 15 the pointer from the head of the selected queue and transmits the packet fi-om the buffer that is 



pointed to by the pointer. 

The tunnel switching operations of the mutiplexing/demultiplexing mechanism 350 are 
shown in more detail in Figs. 4 and 5. Fig. 4 is a block diagram illustrating the tunnel-to-private 
virtual server traffic switching functions of a multiplexing/demultiplexing mechanism. Fig. 5 is 
20 a block diagram illustrating the private virtual server-to-timnel traffic switching functions of a 
multiplexing/demultiplexing mechanism. 

Fig. 4 shows an embodiment of a physical host computer 400 including three private 
virtual servers 420A, 420B, and 420C. Each private virtual server includes an associated IP 

17 
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stack 422. An IP stack is a set of software processes that together manage the transfer of 
information in packets according to Internet protocols. Internet protocols define the rules and 
conventions for exchanging information across the Internet. The number of private virtual 
servers shown is merely illustrative. It is to be understood that a physical host computer may 
5 include more or fewer private virtual servers. 

The physical host computer 400 also includes a multiplexing/demultiplexing mechanism 
410. Multiplexing/demultiplexing mechanism 410 has an internal pointer 430 directed at each IP 
stack 422. Multiplexing/demultiplexing mechanism 410 includes a lookup table 412 that 
includes a list of incoming timnel identifiers and pointers to their associated IP stacks within the 
10 physical host computer 400. Lookup table 412 is created by software residing on the physical 
host computer 400, which associates each IP stack with a particular customer, and ensures that 
transmissions sent fi'om a particular customer are only directed to that particular customer's 
private virtual server. 

A data packet 452 enters the multiplexing/demultiplexing mechanism 410 using an 
15 incoming timnel 450. The tunnel 450 is not an individual physical connection, but is a means of 
encapsulating the packet 452 to permit routing across a public network. Although only one 
incoming txmnel 450 is shown in Fig. 4, this is merely illustrative. It is to be understood that 
there may be multiple different tunnels entering the multiplexing/demultiplexing mechanism 
410. 

20 The tunnel identifying information of the incoming packet 452 identifies which customer 

sent the packet 452. Packet 452 's incoming tunnel identifying information is stripped 446, and 
the tunnel identifying information is presented 444 to the lookup table 412. Lookup table 412 



2181 6/04467/DOCS/967269.8 



18 



returns 442 an internal pointer 430 for the appropriate IP stack 422. Packet 452 is then routed 
440 to the identified IP stack 422 using the internal pointer 430. 

An alternative embodiment is to embed the internal pointer 430 in the control data 
structure that controls the operation of the tunnel. The control data structxire is typically located 
5 on the network interface card. The network interface card is typically located on the physical 
server machine 400. 

Fig. 5 is a block diagram illustrating an embodiment of the private virtual server-to- 
tunnel traffic switching operations for the physical host computer 400. 
Multiplexing/demultiplexing mechanism 410 contains a lookup table 512 that consists of a list of 

fz 10 IP Stacks in the physical host computer 400 and their associated outgoing tunnel identifiers. 

m 

Multiplexing/demuhiplexing mechanism 410 ensures that packets sent from a customer's private 
virtual server are routed back to that customer on the correct outgoing tunnel. 

l^^ A packet 552 is originally sent from the IP stack 422 of one of the private virtual servers 

I s H 

420. The packet 552 is directed 530 to the multiplexing/demultiplexing mechanism 410. Upon 

I n 

^ 15 arrival at the multiplexing/demultiplexing mechanism 410, the internal tunnel IP stack identifier 

O 

is read 540, and this identifier is presented 542 to lookup table 512. 

Lookup table 512 returns 544 the associated outgoing tunnel identifying information. 
The outgoing tunnel identifier is added 546 to packet 552. Packet 552 is then sent out using the 
appropriate outgoing tunnel 550. The outgoing tunnel 550 is associated with the customer 
20 assigned to the private virtual server 420, which originally sent the packet 552. Although only 
one outgoing tunnel is shown in Fig. 5, this is merely illustrative. It should be imderstood that 
there may be multiple different outgoing tunnels. Each tunnel is not a separate physical 
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connection; it is a specific encapsulation of data allowing the data to be separated out from other 
data sent on a physical connection. 

An alternative embodiment is for the IP stack 422 of each private virtual server 420 to 
encapsulate the packet 552 with the proper outgoing tunnel header and tunnel identifier, thereby 
5 creating the tunnel 550. In this embodiment, the lookup table 512 is not used. The 
multiplexer/demultiplexer mechanism 410 merges the encapsulated and identified packet streams 
together, and sends theni out. 

A service provider will typically own and manage multiple physical server machines. 
Additionally, customers may wish to purchase more than one private virtual server, for example, 
10 for separate divisions within the same company. A customer may also have multiple physical 
customer sites using the same private virtual server, wherein each customer site uses a different 
tunnel to conmiunicate with the service provider. A tunnel switch supports these different 
configurations in a private virtual server system. 

A tunnel switch comprises one or more physical interfaces, with each interface capable of 
15 carrying many multiplexed tunnels. A tunnel switch will typically be capable of supporting a 
number of different physical interface technologies and a number of different types of tunnels for 
each type of physical interface. A timnel switch performs two separate services: switching 
tunnels, and switching packets within a tunnel. 

In a switching timnels service, all packets arriving on one incoming tunnel are forwarded 
20 to an outgoing tunnel. This may be implemented without looking into the headers of the packets 
themselves. The tunnel switch notes which tunnel and physical interface the packet arrived on. 
Given the identifier of the incoming tunnel and the incoming physical interface, the tunnel 
switch uses a lookup table to specify the outgoing tunnel and physical interface. 

20 
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In a switching packets service, incoming tunnels are terminated at the tunnel switch. The 
packets within each tunnel are extracted and switched individually based upon the incoming 
physical interface, the incoming tunnel, and information from the header of the packet. A private 
virtual server system supporting multiple physical servers, multiple private virtual servers per 
customer, and multiple customer sites per private virtual server will support such a switching 
packets service in addition to supporting a switching tunnels service. 

Fig. 6 is an illustration of an embodiment of a private virtual server system containing a 
tunnel switch. Private virtual server system 600 provides a separate routing context on behalf of 
each customer to route between the customer and each customer's associated private virtual 
server. A private virtual server system 600 is communicatively coupled to three customer sites 
612, 614, and 616 across a local or regional network 620. The number of customers, physical 
servers, and private virtual servers shown in Fig. 6 is merely representative. It is to be 
understood that a service provider may have more or fewer customers and more or fewer 
physical servers. Furthermore, a physical server may contain more or fewer private virtual 
servers. 

Each customer site is connected to the system 600 via an external tunnel that traverses the 
local or regional network 620 and communicatively couples to a tunnel switch 632. Customer 
site 612 uses external tunnel 622, customer site 614 uses external tunnel 624, and customer site 
616 uses extemal tunnel 626. A tunnel switch 632 operates as the gateway to physical servers 
640 and 650, and supports tunnels on multiple physical interfaces. Tunnel switch 632 is 
communicatively coupled to physical server 640 via a set of tunnels 634. Tunnel switch 632 is 
communicatively coupled to physical server 650 via a set of tunnels 636. 
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Physical server 640 contains a multiplexing/demultiplexing mechanism 642, which is 
linked via a set of internal pointers 662 to a set of private virtual servers 660. Physical server 
650 contains a muUiplexing/demultiplexing mechanism 652, which is linked via a set of internal 
pointers 682 to a set of private virtual servers 680. 

5 Fig. 7 is a block diagram of an embodiment of the functions of a tunnel switch. A tunnel 

switch 700 is connected to a set of physical interfaces 712 and 714. Each physical interface 712 
and 714 is capable of carrying a set of extemal timnels. Physical interface 712 carries tunnels 
71 OA, 71 OB, 7 IOC, 710D, 710E and 71 OF. Physical interface 714 carries tunnels 716A and 
716B. 

10 Tunnel switch 700 also includes a set of outgoing physical interfaces 732 carrying a set 

^ of outgoing tunnels 730 to a set of physical host computers 720. Physical interface 732A carries 
m tunnels 730A and 730B to physical host computer 720A. Physical interface 732B carries tunnel 
P 730C to physical host computer 720B. Physical interface 732C carries tunnels 730D and 730E 

yi to physical host computer 720C. The tuimel switch 700 includes a customer lookup table 800 

I — 

15 and a set of customer forwarding tables 900. The features of the customer lookup table and 
• customer forwarding tables will be discussed in more detail before fully explaining the functions 

of the tunnel switch 700. 

Fig. 8 is an embodiment of a customer lookup table 800, and Fig. 9 is an embodiment of 
a set of customer forwarding tables 900. Together, table 800 and set of tables 900 are suitable 
20 for switching a set of transmissions from an incoming physical interface and tunnel to an 
outgoing physical interface and timnel. An incoming transmission may be arriving at the tunnel 
switch either from a customer, or from a private virtual server. Similarly, an outgoing 
transmission may be directed towards a private virtual server or a customer. Tables 800 and 900 
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operate to switch transmissions in both directions. Customer lookup table 800 is used as an 
index into the correct customer forwarding table from the set of customer forwarding tables 900. 

The customer lookup table 800 associates external tunnel and physical interface 
identifiers with a particular customer. Each customer listed in the customer lookup table 800 has 
5 an associated customer forwarding table. For example, customer I's information is contained in 
customer forwarding table 910, and customer 2's information is contained in customer 
forwarding table 920. When a customer communicates with a private virtual server, each data 
transmission will arrive on a particular physical interface using a particular tunnel. 

Customer lookup table 800 contains four fields: incoming physical interface, incoming 

O 

;J3 10 tunnel identifier, service, and customer identifier. Each incoming physical interface and 

y B 

I^Jf incoming tunnel identifier entry will reference a unique customer identifier. This customer 
identifier provides an index to the correct customer forwarding table associated with this 

J" physical interface/tunnel identifier pair. For example, a transmission arriving on physical 

Q 

bj interface 712 and incoming tunnel 71 OB would be indexed to customer I's customer forwarding 

LJI 15 table (table 910 from Fig. 9). In another example in the opposite direction, a transmission 
tJ arriving on physical interface 732A and incoming txinnel 730B would also be indexed to 

customer 1 's customer forwarding table. 

Each customer forwarding table 910, 920 and 930 contains three fields: destination IP 
address, outgoing tunnel identifier, and outgoing physical interface. Based upon the destination 
20 IP address of a particular transmission, the proper outgoing tunnel and outgoing physical 
interface is determined. Using customer lookup table 910 as an example, transmissions with a 
destination IP address of the "main server" for customer 1 would be placed on outgoing tunnel 
730A on physical interface 732A. In the opposite direction, transmissions with a destination IP 
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address of "site 1" for customer 1 would be placed on outgoing tunnel 710E on physical interface 
712. 



The information in the dustomer lookup tables 900 is segregated by customer because the 
private address spaces of different customers may overlap, and therefore the destination IP 
5 addresses on each individual! customer forwarding table are not unique within the set of all 
customer forwarding tables, ror example, "main server" of customer 1 and "server" of customer 
2 may have the same IP adddsss. 

The service field in /the customer forwarding table 800 identifies whether only a tunnel 
switching service (TS) is required, or a packet switching service (PS) is required. If only a 
10 tunnel switching service is [required, the associated customer forwarding table will contain only a 



single entry specifying the 



proper outgoing tunnel and outgoing physical interface. For example. 



customer lookup table SOD indexes transmissions arriving on physical interface 712 and 



incoming tunnel 7 IOC tc 
txmnel switching service. 



customer 2, and identifies these transmissions as requiring only a 
Customer lookup table 920 associated with customer 2 directs all 



15 traffic to outgoing timnel '^30D on physical interface 732C. 

The customer lookup table 800 and customer forwarding tables 900 allow the tunnel 
switch 700 to support a variety of different private network configurations. For example, 
customer lookup table 800 shows that customer 1 uses two different incoming tunnels: 71 OA 
and 71 OB. Customer forwarding table 910 shows that customer 1 also has two different 
20 destination IP addresses corresponding to two different private virtual servers: "main server" 
and "backup server." Additionally, customer 1 has two different destination IP addresses 
corresponding to two different customer sites: "site 1" and "site 2." However, customer 
forwarding table 920 shows that customer 2 has only one private virtual server ("server"). The 



2181 6/04467/DOCS/967269.8 



24 




example private network configurations referred to herein are merely illustrative. It will be 
understood by one of skill in the art that many different configurations are possible. 

Referring back to Fig. 7, Fig. 7 shows the steps associated with switching a packet 
between an external tunnel (in one embodiment, fi'om a customer site) and a private virtual 
5 server. A physical interface 712 connects a set of external tunnels 710 to the tunnel switch 700. 
A packet 718 arrives on one of the external tunnels 71 OB. The incoming physical interface and 
tunnel identification information is read 740 from the packet 718, and presented 744 to a 
customer lookup table 800. 

The customer lookup table 800 uses the physical interface and tunnel identifier to return 

o 

J3 10 748 the correct customer forwarding table (910) for use with the packet 718. A group of 

yi 

customer forwarding tables 900 contains a customer forwarding table 910 that is associated with 
;tf the customer that uses physical interface 712 and tunnel 71 OB. Packet 718's destination IP 

address, for example, "main server" is presented 750 to customer forwarding table 910. 

MJ From the information contained in customer forwarding table 910, the correct outgoing 

Jfi 15 physical interface and tunnel identifier for packet 718 is identified 754. Referring to Fig. 9, 
destination IP address "main server" corresponds to outgoing tunnel 730A and physical interface 
732 A. Packet 718 is then placed on tunnel 730A that will transport it to the physical host 
computer 720A. 

Customers utilizing a private virtual server system may also be accessing the global 
20 Internet. In this case, both the private virtual server communications traffic and the Internet 
communications traffic are sent out on a public network. A method for separating the two traffic 
streams is required. 



2181 6/04467/DOCS/967269.8 



p 

nJ 



In one embodiment, shown in Fig. lOA, Internet traffic is separated out at the customer's 
site. Fig. lOA shows a system 1000 for separating Internet and private virtual server traffic. In 
system 1000, a traffic separation mechanism 1012 is located at the customer site 1010. A tunnel 
1022 is created for sending private virtual server traffic across the local or regional network 
5 1020. Internet traffic 1024 is separated out before reaching the local or regional network 1020 
and sent separately to the Intemet 1030. 

Fig. lOB shows another embodiment of a system for separating Intemet and private 
virtual server traffic. System 1050 separates Intemet traffic out after all customer traffic has 
reached a private virtual server system 1040. A customer site 1010 sends both Intemet and 
10 private virtual server traffic out on a tunnel 1026 across the local or regional network 1020. All 
traffic arrives at the private virtual server system 1040 through a tunnel switch 1060. 

Within the tunnel switch 1060, traffic addressed to the Intemet is segregated out fi-om 
traffic directed to the customer's private virtual server(s). The Intemet traffic is sent out to the 
Intemet 1030 via a public conmiimications channel 1064. Intemet responses back to the 



yj 

U] 15 customer are retumed in the same way that they were sent. The tunnel switch 1060 sends private 

O 

Q virtual server traffic out on an internal tunnel 1062 to the physical server machine 1070 that 
holds the customer's private virtual server. 

A variety of tunneling protocols may be used to create the timnels used in the present 
invention. It is preferable to use a layer 2 tunneling protocol for security purposes. Layer 2 
20 tunnels provide solid circuits that make it difficult to "spoof a fake source address. Packets 
using a layer 3 tunneling protocol may be created with a fake IP address, allowing a packet to 
appear to come fi-om a customer when in fact it was sent by an unauthorized third party. Tunnels 
using a layer 3 tunneling protocol require encryption so that an intmder cannot decode the 
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information. Encryption is also required to protect against accidentally routing the traffic to an 
incorrect destination, because the encryption will prevent mis-directed traffic from being 
decoded. Preference for txinnel type depends upon the service provider's network architecture. 

Typical examples of tunnel protocols include Asynchronous Transfer Mode virtual 
circuits (ATM VCs), frame relay virtual circuits (FR VCs), the Point-to-Point Protocol (PPP) 
across the Layer 2 Tunneling Protocol (L2TP), and IP security protocol (IPsec). ATM or frame 
relay virtual circuits may be delivered to a customer using Digital Subscriber Line (DSL) access. 
However, it will be evident to one of skill in the art that other tunneling protocols may be used to 
implement the txmnels of the present invention. 

Fig. 1 1 is an illustration of an embodiment of a private virtual server system using ATM 
layer 2 tunneling with DSL access. A system 1100 spans a customer site 1110, a local or 
regional network 1 140, and a service provider 1 150. 

The customer site 1110 contains a group of computers 1 1 12A, 1 1 12B, and 1 1 12C. The 
computers 1112 are representative of the customer's on-site private network. Such a private 
network could be comprised of more or fewer individual computers, as well as other types of 
equipment such as storage devices. 

Components within a customer's on-site private network communicate using a private IP 
addressing scheme. A packet 1 1 14 is a privately-addressed transmission sent using the local IP 
protocol of the customer site 1110. Packet 1 1 14 is sent from customer 1 1 10 to customer 1 1 lO's 
private virtual server. Packet 1114 has a destination address corresponding to a private virtual 
server of service provider 1 150. 
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The on-site private network of devices 1112 is connected to a customer premise 
equipment box (CPE) 1 120. Packet 1 14 is routed to CPE 1 120. The CPE connects the customer 
site 1110 to a tunnel 1132, estabhshed between the customer site 1110 and the service provider 
site 1 150. The tunnel functions as a bi-directional data pipe, and is typically established when a 
customer subscribes to a service provider providing a tunneling service. A fixed ATM tunnel is 
referred to as a permanent virtual circuit. The CPE divides the data of packet 1114 into cells (or 
packets) of a fixed size designated by the ATM protocol, and encapsulates them with a Virtual 
Channel Identifier (VCI) used to direct the cells through the data pipe. An ATM cell 1118 is 
created from the division and encapsulation of packet 1114. 

Tunnel 1132 terminates at a tunnel switch 1160 of the service provider 1150. Tunnel 
switch 1160 is connected via a set of bi-directional ATM tunnels 1172 to a set of physical 
servers 1 1 70. In another embodiment, two sets of unidirectional tunnels are used to provide a 
two-way connection between customer site 1110 and service provider 1 150. 

Fig. 12 shows an embodiment of the traffic flow of an ATM cell from a tunnel to a 
private virtual server. The system of Fig. 12 presents in more detail the functions of the service 
provider data service center 1 150 shown in Fig. 11. In Fig. 12, the service provider data service 
center 1150 contains the txmnel switch 1160 and a physical host computer 1170. It is to be 
understood that more than one physical host computer 1 170 may be included in system 1 150. 

A set of incoming external tunnels 1132 terminates at the tunnel switch 1160. Tunnel 
1132B carries the incoming ATM cell 1118. Referring back to Fig. 11, ATM cell 1118 is 
created by the ATM CPE 1120 on the customer site 1110. ATM cell 1118 is created from a 
privately-addressed IP packet 1114 originally sent by one of the computers 1112. 
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In Fig. 12, the VCI identifying the incoming tunnel of ATM cell 1 1 18 is read 1212, and 
presented 1214 to a customer lookup table 1230. Customer lookup table 1230 returns 1216 the 
correct customer forwarding table (1232B). Table 1232B is accessed from a set of customer 
forwarding tables 1232. 

5 Customer forwarding table 1232B returns 1218 the identity of the outgoing tunnel 

required to reach the correct private virtual server destination (1250A) for ATM cell 1 118. ATM 
cell 1118 is then placed 1220 on an intemal tunnel 1172 to reach the private virtual server 
1250A. Intemal tunnel 1 172 terminates at a multiplexing/demultiplexing mechanism 1290 of the 
physical host computer 1 170, which contains private virtual server 1250A. 

10 The VCI of ATM cell 1118 is stripped 1252, and the VCI is presented 1254 to lookup 

table 1260. The rest of the ATM cell 1118, including the original source/destination addresses 
and payload, is held until the original IP packet 1114 sent by a customer 1112 can be 
reassembled. The ATM protocol uses relatively small cells compared to other transmission 
protocols. Therefore multiple ATM cells may be required to reassemble the original pre-ATM- 

15 encapsulation packet 1114. 

Once the original IP packet 1114 has been reassembled 1262, the location of the IP stack 
of the destination private virtual server 1250A is retrieved 1256 from lookup table 1260. Packet 
1 1 14 is routed 1280 to the IP stack of private virtual server 1250A. 

Although the invention has been described in considerable detail with reference to certain 
20 embodiments, other embodiments are possible. As will be understood by those of skill in the art, 
the invention may be embodied in other specific forms without departing from the essential 
characteristics thereof For example, different protocols may be used to create tunnels. 
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Accordingly, the present invention is intended to embrace all such alternatives, modifications 
and variations as fall within the spirit and scope of the appended claims and equivalents. 
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